Stochastic Abstract Policies for Knowledge Transfer in Robotic Navigation Tasks
نویسندگان
چکیده
Most work in navigation approaches for mobile robots does not take into account existing solutions to similar problems when learning a policy to solve a new problem, and consequently solves the current navigation problem from scratch. In this article we investigate a knowledge transfer technique that enables the use of a previously know policy from one or more related source tasks in a new task. Here we represent the knowledge learned as a stochastic abstract policy, which can be induced from a training set given by a set of navigation examples of state-action sequences executed successfully by a robot to achieve a specific goal in a given environment. We propose both a probabilistic and a nondeterministic abstract policy, in order to preserve the occurrence of all actions identified in the inductive process. Experiments carried out attest to the effectiveness and efficiency of our proposal.
منابع مشابه
Reusing Risk-Aware Stochastic Abstract Policies in Robotic Navigation Learning
In this paper we improve learning performance of a riskaware robot facing navigation tasks by employing transfer learning; that is, we use information from a previously solved task to accelerate learning in a new task. To do so, we transfer risk-aware memoryless stochastic abstract policies into a new task. We show how to incorporate riskawareness into robotic navigation tasks, in particular wh...
متن کاملSpeeding-up reinforcement learning through abstraction and transfer learning
We are interested in the following general question: is it possible to abstract knowledge that is generated while learning the solution of a problem, so that this abstraction can accelerate the learning process? Moreover, is it possible to transfer and reuse the acquired abstract knowledge to accelerate the learning process for future similar tasks? We propose a framework for conducting simulta...
متن کاملEfficient State Spaces and Policy Transfer for Robot Navigation
Autonomous mobile robots are critical in many real world applications, ranging from planetary exploration to search and rescue. Indeed, the application domains using such robots are steadily increasing, and as the robots get smaller, navigation policies that operate with reduced computational and memory requirements become critical. In addition, as tasks become more complex, directly developing...
متن کاملGeneralization and Transfer Learning in Noise-Affected Robot Navigation Tasks
When a robot learns to solve a goal-directed navigation task with reinforcement learning, the acquired strategy can usually exclusively be applied to the task that has been learned. Knowledge transfer to other tasks and environments is a great challenge, and the transfer learning ability crucially depends on the chosen state space representation. This work shows how an agent-centered qualitativ...
متن کاملStructural Knowledge Transfer by Spatial Abstraction for Learning Agents
In this article we investigate the role of abstraction principles for knowledge transfer in agent control learning tasks. We analyze abstraction from a formal point of view and characterize three distinct facets: aspectualization, coarsening, and conceptual classification. The taxonomy we develop allows us to interrelate existing approaches to abstraction, leading to a code of practice for desi...
متن کاملذخیره در منابع من
با ذخیره ی این منبع در منابع من، دسترسی به آن را برای استفاده های بعدی آسان تر کنید
عنوان ژورنال:
دوره شماره
صفحات -
تاریخ انتشار 2011